ON THE SPECTRAL DENSITY OF LARGE SAMPLE 
COVARIANCE MATRICES WITH MARKOV DEPENDENT 

COLUMNS 

OLGA FRIESEN AND MATTHIAS LOWE 

pg Abstract. We investigate the spectral distribution of large sample covariance 

y—i matrices with independent columns and entries in the columns that stem from 

Markov chains. We characterize the limiting spectral densities by their moments. 

Correspondingly, the proof is based on a moment method. 

s 

\Q 1. Introduction 

Random matrix theory is one of the most active fields in modern probability theory. 
One of its central questions is the analysis of the spectra of random matrices. There 
are basically three types of those which have always been in the center of interest: 
matrices with independent entries (possibly up to symmetry conditions), matrices 
with invariance properties, e.g. orthogonal or unitary invariance, and sample covari- 
ance matrices. The present paper is devoted to the study of the latter. 
To be more precise, we consider an m(n) x n matrix X n with each column being an 
independent copy of a stationary sequence whose joint moments satisfy appropriate 
>■ conditions. We are interested in the sample covariance matrix 

On i 

W = -X X T 
r*~ n 

If Ai,... , \ m (n) denote the eigenvalues of W n (with multiplicities), we define the 

q empirical spectral measure as 

(N 
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m(n) 



Hn ■= — rr 7 , &. 



=1 



A, • 



m[n) 

•i-H 

where Sxj denotes the Dirac measure supported in Xj. One of the starting point of 
modern random matrix theory is the study of the asymptotics of \x n as n — > oo and 

m(n) . _ (c \ 

~Y ^y e (0,oo). 

Sample covariance matrices are an important tool in statistics, in particular in multi- 
variate statistical inference. There, test statistics are often defined by the eigenvalues 
or functionals of sample covariance matrices. The first and pioneering results for the 
spectra of sample covariance matrices were obtained under the assumption that all 
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2 OLGA FRIESEN AND MATTHIAS LOWE 

entries of X n are i.i.d. (and not only the columns). Under these conditions Pastur 
and Marcenko |MP67j obtained their famous Pastur-Marcenko law for the limiting 
spectral distribution. Extensions of their result can be found in the work of Wachter 
|Wac78] and Yin |Yin86j . for a very readable survey paper we refer to |Bai99j . 
For many practical purposes, the assumption that not only the columns but also 
the entries of the columns are i.i.d. is rather restrictive. Various attempts have 

thus been made to relax this condition. Silverstein |Sil95] studied matrices of the 

i 

form X n = TnY n , where T n is a non-negative definite matrix and Y n consists of 
i.i.d. entries. Another attempt to relax the independence assumption was made in 
Yin and Krishnaiah |YK85] . They assumed that the columns of X n are distributed 
isotropically. Also this result was extended to the case where X n is the product of a 
non- negative definite matrix with an isotropically distributed matrix (see |BYK86] ) . 
A very general dependence structure has been considered in |BZ08j . There the lim- 
iting measure can be characterized via its Stieltjes transform. Yet another approach 
was used by Anderson and Zeitouni, who assume joint cumulant summability of the 
matrix entries, see |AZ08j . in particular Assumption 2.2 there. 
However, all these results do not seem to cover our model in full generality. The 
aim of the present paper is to derive the limiting spectral distribution of matrices 
with independent columns, the entries of which are correlated via a Markov process 
and fulfill suitable conditions. Our main technique is a moment method. The 
corresponding combinatorial problems will be solved using a graph-theoretical result 
(see |Kre72j ). 

The rest of the paper is organized in the following way: In the next section we 
describe the model we are dealing with in detail and formulate our central result. 
Section [3] is devoted to examples, while Section [4] contains the proofs. 

2. The Model and the Main Result 

Suppose that {a(i,j),i G N}, j G N, are independent and identically distributed 
families of real- valued stationary random variables. Define for any m,n G N the 
m x n matrix X n = (a(i, j))i<i<m,i<j<n, and assume that m tends to infinity pro- 
portionally to n, that is 

m 

y y G (0, oo), as n — y oo. 

n 

Our aim is to impose appropriate conditions on the entries of X n to obtain con- 
vergence of the expected empirical distribution of the m x m sample covariance 
matrix 

w n = -x n x£, 

n 

in a situation where the columns of X n contain Markov processes. In order to 
describe such a limit, we will have to control the mixed moments of the entries. 
Thus, we start with the covariances, and put for any i,i' G N, 

t(i,i') := Cov (a(i,j),a(i',j)), 

which does not depend on j G N. For any m G N, denote by T m = (i(i,i'))i<i,i'<m 
the covariance matrix of the sequence {a(i,j), 1 < i < m}. Assume that for any 
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k G N, the sequence of the k-th moments of the empirical spectral distribution v m 
of T m converges, and put 

H k := lim f x k v m {dx) = lim — tr (T* ) . (2.1) 

m—too J m— >oo Tfl 

To state the remaining conditions, we need to introduce some notation. Hence, for 
j = 1, . . . , k, we denote by S 3 2k the set of all permutations a of {1, ... , 2k} such that 
{ct(2Z-1), a {21)} + {2Z'-1, 21'} for at least one I G {1, . . . , j} and any V G {1, . . . , k}. 
Now assume that for any mGN, there is a deterministic m x m matrix 

T' m = (£'(M'))i<M'< m = (a M '')i<M'<r 



; m) 



with a G [0, 1), such that for any k EN and Zi, . . . , i 2 fc G {1, . . . , m}, i\< . . . < iik-, 
(Al) we have 

k 

E [a(«i, 1) ■ . . . ■ o(i 2 fc, 1)] = ] J *(*2i-i, «2/) + -R(*i, • • • , i2k), 

1=1 

where 

k j 

\R(ii,...,i 2 k)\ <c(k)Y^ Yl II*'^ 2 '- 1 )'^))' 

with c(k) > depending only on k and not on m, 
(A2) it holds that 

k 

|E [a(ii, 1) •... • a(i 2 k, 1)]| < c(fc) J|t'(i 2 z-i,ia)- 

Note that none of the conditions (Al) and (A2) implies the other. The quality of the 
estimates depends on the particular choice of the elements i\ < . . . < i 2 k- Moreover, 
(Al) and (A2) entail the existence of moments of all orders. In Section pi we will 
present some examples of stationary processes that satisfy the conditions above. 
In particular, such processes necessarily have exponentially decaying covariances 
which is the case for many Markov processes. The definition of the sets S 3 2k and the 
estimate in (A2) are basically motivated by the representation of the joint moments 
of a Gaussian process. Here, Isserlis' theorem |Issl8j states that 



E [o(ii, 1) •... ■ a(i 2k , 1)] = Yl *(*«-!, »2i) + Y II *(M«-i)» «<T 



(20, 



1=1 «r6S a \ 1=1 



It will become obvious that in our situation, condition (A2) is the most restrictive 
since it basically demands the underlying distribution to be symmetric. Our main 
result is 
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Theorem 2.1. Assume that (2.1), (Al), and (A2) hold. Then, the expected empir- 
ical spectral distribution of W n converges weakly to a probability measure with k-th 
moment equal to 

ty'-'l. E LTff- < 2 - 2 > 

s=l ii + ...+i a =k— s+1, 1=1 

ii+2i 2 +...+si a =k 

Remark 2.2. Let Y n be an m x n random matrix with i.i.d. entries. In the proof of 



Theorem 4.1 in |BS10] , we see that the limiting distribution in Theorem 2.1 coincides 
with that of -Y„Y n T m . This is not surprising, at least when considering Gaussian 
entries. Indeed, if T m is a positive definite matrix with Cholesky decomposition 
T m = L m L^, then ^Y n Y^T m has the same limiting distribution as ^L m Y n Y^L^. 
Assuming that the entries of Y n are Gaussian, we see that the matrix L m Y n has an 
independent copy of the same Gaussian Markov process in each column. 



Remark 2.3. The moments in Theorem 2.1 satisfy the Carleman condition (cf 



[BSIQ], Lemma 4.9). Hence, they determine the limiting probability distribution 
uniquely. 



Remark 2.4 (Random Fields). A natural extension of Theorem 2.1 is to consider the 
limiting spectral distribution of matrices 

1 T 

-X„Q n X n , 

where Q n := (q{i,j))i<i,j< n is a deterministic symmetric n x n matrix. If Q n is 
positive definite, and Q n = L n L n for a lower triangular matrix L n , then the matrix 
Y n := X n L n forms a Markov random field on a lattice. Now assume that the 



conditions of Theorem 2.1 hold, and for any k G N, ii, ■ ■ ■ ,i2k-i G N, we have 
E[a(ii,j) • ... • a{i 2 k-i,j)] = 0. Further, put Q' n := (\q(i,j)\)i<ij< n , and suppose 
that the limit lin^oo ^tr((Q^) fc ) exists for any k G N. Define 

H k := lim -tr (Q^) . 

n— »oo Tl 



One can apply similar techniques as in the proof of Theorem 2A to show that the 
k-th moment of the expected empirical spectral distribution of ^X n Q n X n converges 
to 



ev~*(* -)'(«- i)i e nfr e n 



if. i — * -"--"- iii 

s=l h+...+i s =k-s+l, 1=1 ji+...+j k - s +i=s, 1=1 

h+2i 2 +...+si s =k ji+2j 2 +-+{k-s+l)j k _ a+1 =k 

The proof will be given in a separate article. 

3. Examples 

3.1. Independent Random Variables. Suppose that the families {a(i,j),i G N}, 
j G N, consist of i.i.d. random variables with zero mean and variance a 2 > 0. More- 
over, for any k G N, we assume that m(2k) := E[o(i, j) 2k ] < oo, and E[a(i, j) 2k ^ 1 } = 
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0. In this case, we have T m = a 2 I m , implying that 

1 



m 



tr (It) 



a 



Consequently, (2.1 ) holds with Hk = a 2k . Now choose T' m = T m , and fix i\ < . . . < 
%2k- If the value of some %% occurs only once, then 

k 

E[o(»i,l) ■ ... -o(i 2 fc,l)] = = JJt(i 2 j_i,i»). 

i=i 

If %\ — %2 < iz — H < ■ ■ ■ < hk-i = *2fc, we have that 

k 

E [a(ii, 1) ■... • a(i 2k , 1)] = ° 2k = JJ *(i 2 j-i, in), 

1=1 

implying (Al) in this situation. In any other case, we can conclude that the sum 
J2aes j m=i*'(M22-i); V(2o) nas a t least one constant term. Thus, (Al) holds since 
the boundedness of the moments and the Holder inequality yield 

\E[a(ii,j) • ... -a(i2k,j)]\ < m(2k). 

Since the elements ii, . . . , %ik are sorted, we know that the identity \\ l=1 t(i2i-i, %2i) = 
entails the existence of an odd number j such that %i — . . . — ii+j-i for some I, 
and iii ^ %i for any V (£ {I, . . . , I + j — 1}. In this case, there is an odd moment 
that occurs in the product E [a(ii, 1) ■ . . . • a(i 2 k, 1)], implying that this expectation 
is also equal to zero. If Y[i=i^2i-i,Hi) ^ 0, then rL=i tjhi-u hi) — & 2k , an d we 
can put c(k) := m(2k)/cr 2k to obtain condition (A2). By Theorem 2.1 , we thus have 

lim -E [tr (Wj)] = a 2k T V^ ~* E fl K 

s=\ i 1 +...+i s =k-s+l, 1=1 

i\+2i2 + ...+si s =k 

Denoting by NC'^(fc) the set of all non-crossing partitions of {1, ... , k} with i blocks, 
Lemma |4.7| yields 



fe! 



E Il i [ = #NC^ +1 )(A;), 



s\ * — ' ■*■■*■ li 

il+...+i s =fc— s+1, /=1 

ii+2i 2 +...+si a =k 

implying 

fe-i 



lim -E [tr (W*)l = a 2k V y* #NC (m) (A:). (3.1) 

n->-oo 777, *-^ 



m 

i=0 



It was proven in [Kre72j . Corollary 4.1, that 



k\ij\i + lj i + l\ij\ i 



Substituting this identity in (3.1 ), we exactly obtain the moments of the Marcenko- 
Pastur distribution with parameter y G (0, oo) ( |BS10j . Lemma 3.1). 
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3.2. Stationary Processes on a Finite State Space. Let {a(i),ieN} be a 

stationary process on a finite state space S = {si, . . . , Sjv}, N > 2. Denote by 
ix = (7ri, . . . , tin) the stationary distribution. Further, suppose that E[o(l)] = 
and, for any k, I G N, / < k, i\ < . . . < ik, 



max 

j u ...,j k e{i,...,N} 



P (a(i fe ) 



7 ]ki 



...,a[%i) = 
-P(o(i fc ) = .s 



a(ii-i, 



D 3l-li 



l(h) = s h ) 



3kt 



,a[ii) 



(3.2) 



<Ca 



n-n-\ 



Before continuing, let us consider some concrete examples. On the one hand, aperi- 
odic and irreducible Markov chains satisfy this inequality. On the other hand, we can 
also consider different Gibbs measures. To be more precise, assume that the joint 
distribution of the process {a(i),i 6 Z} is a Gibbs measure for some shift-invariant 
potential $ = {<pA : A C Z,0 < \A\ < oo}. Due to |Geo88] , Chapter 8, the estimate 
in dJOb holds if 



E e m ^ A \\A\ -1) sup \M0 ~MV) I <oo, 

A:0eA G'* 1 



(3.3) 



for some t > 0, and Dobrushin's condition is satisfied. Since we consider a shift- 
invariant potential $, the latter is true if 



E (\A\ -1) sup 1^(0" Mv)\ < 2- 

A-.oeA ^' V 



(3.4) 



If we take, for example, a potential with finite range, then (3.3) is satisfied. If 
we consider a Gibbs measure with a parameter ft > 0, i.e. we substitute $ by 
§[3 := {ft(f>A '■ A C Z, < \A\ < oo}, then (3.4) holds whenever ft is small enough. 

To verify condition (Al), the assumptions made are sufficient. This is also the case 
for the prove of ( 2.1[ ). However, in order to obtain (A2), we have to assume that for 
any {ii,...,i k ) 6Tf, 

E[o(ii) • . . . • a(i k )] = 0, 

whenever k G N is odd. In particular, we have that o(l) and — o(l) are equally 
distributed, implying that 7r is symmetric. 



Note that for any k G N, I < k, %\ < . . . < ii-\ < %i < . . . < ik, and di, . . . , dk G N, 
it holds that 

E[a(t k ) dk ■ . . . ■ a(n) dl \ o(i,_i), . . . , o(ii)] 

N 

Ed-k di -ri 

S jk ' ' ' ' ' S ji 1 {a(*i-l)=«j i _ 1 v,a(u)=^ 1 } 

il,---Jfe=l 



P (0(1*) 



3 jfc' 



...,o(zj) 



aUi-i/ 



Sjj_ 1( . . . , a(*ij — SjjJ . 



Consequently, (3.2) implies 



|E[a(i fe ) d * ■ . . . • a(ii) d ' | o(i,_i), . . • , o(ii)] - E[a(i fc ) dfc • . . . ■ a(z,) di ] I < Ca 



H—H-l 



(3.5) 
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We want to start with verifying the convergence of the empirical spectral distribution 
of T m . Since the considered process is stationary, we can define R(j) = t(l,j + 1) = 
E[a(l)a(j + 1)], j G N , implying that T m = (R(\j - f\))i<jj'< m - Note that in 
particular, we have for any j G No, 

\R(j)\ = |E [o(l) (E[a(j + l)|o(l)] - E[a(j + 1)])]| < Co*. 

Consequently, the covariances are summable, which entails the existence of the spec- 
tral density / : [0, 1] -)- R, 

f(x) = J2e 2m3X RU), 

jez 

where R{—j) '■= R{j) for any j > 1. In this case, Szego's limit theorem yields that 
the moments of the empirical spectral distribution v m of T m converge. To be more 
precise, we obtain for any k G N, 



lim / x fc v m (dx) 



f(x) k dx. 



Thus, (2.1) holds. Now put p = tfa, and t'(i,j) = p' ! ^, 1 < i,j < m. Let 
i\ < . . . <i2k- To obtain assumption (Al), it suffices to verify that 



E[o(li) • • • • • 0(l 2 fc)] = Yl *(*2l-l,*2i) + -R(il, • • • , «2fc), 



(3.6) 



Z=l 



where 



fe-i 



|i2(« 



i) 



»2fc)l ^ C ^2 a 



121+1-121 



(3.7) 



1=1 



To achieve this aim, first consider k — 1. In this case, the identity in (3.6) holds with 
R(ii, . . . ,i2k) — 0. Now take any arbitrary k G N and assume that our statement 
holds for any k' < k. We can apply (3.5) to obtain 



E[a(ii) 

= E 



...- a(i 2 k)} 
a(ii)a(i 2 ) (E[a(i 3 ) • . . . • a(« 2 fc) I a(ii), o(z 2 )] - E[o(i 3 ) • . . . • a(i 2k )} 



+ t(ii,i 2 ) E[o(i 3 ) • ••• ■ a(i 2 fe)] 
JJ*(*2i-i,»a) +-R(»i,...,*2fc), 



(3- 



z=i 



with 



fe-i 



|i?(zi,...,* 2 ,OI<CV^- i2 +C'J>* 



21 + 1— *2i 



Z=2 



fc-1 

z=i 



a 



*2i + l-*2! 
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Hence, condition (Al) holds. To prove (A2), note that the fact that all odd mixed 
moments vanish implies that for I < k, we have 

E[a(h) ■ ... ■ a(i 2k )\ 



E 



a[%i) ■ ...■ a{i2i-i) 

E[a{i 2 i) ■ ■■■■ a{i 2k ) | a(h), . . . , o(z a _i)] - E[a(« 2 /) • • • • • a(i 2k )} 



Again, the estimate in (3.5) ensures that 

\E[a{i x )-...-a{i 2k )\\<Ca^-^-\ 
Since this relation holds for any I = 1, . . . , k, we can conclude 

k 

|E[o(ii) • . . . • a(i 2 fc)]| < Ca maxfe - i2i - i:i=1 '-' fc} < C J] 



P' 

1=1 



*2l-l2l-l 



3.3. Gaussian Processes. Assume that for any j G N, the stationary process 
{a(i,j),i G N} is Gaussian with zero mean. By Isserlis' theorem, assumption (Al) 
holds. Moreover, if {a(i,j),i G N} is additionally a non-degenerated Markov process, 
we can conclude that t(i,i') = p^~ l ' for some —1 < p < 1 and any i,i' G N. In 
particular, (A2) is satisfied. The convergence of the empirical spectral distribution 
of T m has been verified in the previous example. 



4. Proof of Theorem 12.11 

The idea of the proof is to use the method of moments. Thus, we want to show that 
for any fceN, the fc-th moment of the expected empirical spectral distribution p, n 



of W n converges to (2.2) as n — > oo. Our starting point is the identity 



/ 



x k jB n (ds) = -E[tr(Wj)] 

m 

^ m n 

5^ $Z E i -^' h)a(i2, ji)a(i 2 , j 2 )a(i 3 , j 2 ) ■ ...■ a(i k ,jk)a(iijk)] ■ 

i 1 ,...,i k =lji,...,j k =l 



mn k 



4.1. The independence of the columns. Let k G N and denote by V(k) the 
set of all partitions of {1, . . . , k}. We say that two elements 1,1' G {1, . . . , k} are 
equivalent with respect to a partition it G V{k), and write I ~ n I', if / and I' are in 
the same block of it. Further, for any fixed n G V(k), define S n (ir) to be the set of 
all fc-tuples (ji, ■ ■ ■ ,jk) € {1, . . . , n} such that 

jl = JV «=> I ~7T I'- 



THE SPECTRAL DENSITY OF LARGE COVARIANCE MATRICES WITH DEPENDENCE 9 

In particular, we have that for (j 1; . . . , j k ) G S n (ir), the entries a{ix : ji x ), . . . , a(i p ,ji) 
are independent whenever / 1; . . . , l p belong to different blocks of it. Thus, we obtain 



;;/ 



run* 



-. -. ttl r- K 

- e ^ (w*)] = — k e e e e \[<^ji)<ii^ji) 

neV(k) (ji,-,jk)&S n (TT) ti,...,j fc =l L Z=l 

E II E II a( ^' 3i)a(ii+i, ji) 



— y y 

mn k / -— ' / -— ' 



^eP(fc) (ji,-Jfc)G5 n (7r) ii,...,j fe =l s=l 



teB« 



where we cyclically identify k + 1 with 1, and write #7r for the number of blocks of 
7r denoted by .B^ , . . . , B„ . Since we assumed the columns of X n to be identically 
distributed, we conclude 

-E [tr (W k n )] = — ^ J] #S n (vr) £ n E n^ 1 ) ^!,!) 



/» 



mti 1 



TreP(fc) 



ii,...,jfc=l s=l 



ZeBl s) 



To fix some element in S n (jr), we have to choose for each block of it one value 
in {l,...,n}. By definition, those values are supposed to be distinct, implying 
#S n (7r) = n(n — 1) • . . . • (n — #7r + 1). We thus arrive at 

-, -, m #n r- 

lim -E [tr (W*)] = lim £^__ ^ J| E J[ a(i h l)a(i l+1 , 1 

i-inn rn L v ' J n— s-nn ^— ' rnr) K it 11 *—* J- J. J. J. 



n->oo m 



TreP(fc) »i,...,j fe =la=l 



'ZeB 



(») 



(4.1) 



if the limits exist. 

4.2. Consistent graphs. Our final aim is to use assumption (Al) in order to 



deduce a representation of the expectations in (4.1) with products of the form 



t{liih)t(l2,h) ■ ■ ■ ■ ■ t(ld-i,ld)t(ld,h)- This would lead to the occurrence of traces 
tr(T m ). In this case, relation (2.1) could be used to compute the limit in (4.1). 



Toward this end, we start with some definitions. Thus, fix it G V(k) and denote for 
any s — 1, . . . , #7r the closed blocks of 7r by 

B[ s) :=B^u{le{l,...,k}:l-leB^}, 

where is identified with k. Moreover, define the function m^ : {1, . . . , k} —$■ {1,2} 
by 

'l, if/ fa l-l, 

2, if I ~^ I - 1. 



m n (l) 



( s \ ( s ) 

If I G B n for some s = 1, . . . , #7r, then ro,(I) is the multiplicity of I in B n . This 

definition allows us to write 



E 



Yl a(i h l)a(ii+i,l) =E ]~J a(i h l) 



'leB. 



M 



\m,T T (l) 



leB 



« 



(4.2) 



In order to employ the representation of the mixed moments in (Al), it will be 

— (s) 

necessary to sort the elements ii, I G B , for any s = 1, . . . , #7r. The idea is to 
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introduce certain graphs on the circle {l,...,k} such that an edge between two 

— (s) 

vertices v and w indicates that both are elements of the same set B n , and i v and 
i w are neighbors concerning their size. To make this description more precise, we 
begin with 

Definition 4.1 (Consistent Graphs). Let G be an undirected multigraph with vertex 
set V(G) = {1, . . . , k} and edge set E(G) = {e t , . . . , e k }, and let f G : E -> V U [V] 2 
be a function assigning to each edge either one or two vertices called the ends of 
the edge. We say that G is consistent with it if it is possible to decompose G into 



subgraphs G*, s 



t(s) 



(»)/ 



#n, with vertex sets B n and edge sets E W S '(G), such that 



W 



(CI) the degree of a vertex I in the subgraph Gn equals m n (l), 
(C2) E(G) is the disjoint union of the sets E n s (G), s — 1, 



#7T. 



In other words, a 7r-consistent graph G can be constructed by connecting the ele- 
ments of any set B n according to their multiplicities (Figure 1). 



7 O 



1 

o 



o 

5 





6 \ 



Figure 1. Here, we take ix e V(8) with b[ 1] = {1,2,3,5,6} and 



B 



(2) 



>(1) 



{4,7,8}, implying that B\ ' = {1,2,3,4,5,6,7} and B* 



(2) 



{1,4,5,7,8}. In the first picture, we see those vertices colored black 
which are only contained in B n , and those colored white which are 

(2) 

only in B n . If some element is in the intersection of the two sets, 
we color it grey. For any black or white vertex I, we have m n (l) = 2. 
If I is grey, we have m n (l) = 1. To obtain a 7r-consistent graph, we 
first connect all black and grey vertices with each other, where the 
number of edges which are connected to any vertex I equals m n (l). 
This leads, for example, to the graph in the second picture. Similarly, 
we connect all white and grey vertices respecting their multiplicities. 
One possibility to do so is shown in the third picture. The edges of 
the subgraph G n are the continuous lines and those of G\ are the 
dashed lines. 
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Remarks 4.2. (i) The same graph can be consistent with different partitions, 

(ii) Any vertex in a consistent graph has degree two. This implies that any 

connected component of a consistent graph is a cycle, 
(hi) Any graph G with vertex set V{G) = {1, . . . ,k} and edge set E{G) such 
that each vertex has degree 2 is consistent with the partition n of {1, . . . , k} 
with only one block. 

(iv) Both ends of any edge e G E(G) are in the same set B n for some s = 

l,...,#7r, thatis/ G (e)CEi s) . 
(v) If G is consistent with some it G V(k), then the subgraphs G^ , s = 

1, . . . , #7r, are uniquely determined apart from their order. 



We denote by X(7r) the set of all graphs consistent with the partition it G V(k). To 
relate any tuple i = (h, ■ ■ ■ ,ik) G {1, . . . , m\ to a graph G G 1{iv) which reflects 
the structure of i within the closed blocks of w, we proceed as follows: 



(i) For any s = 1, . . . , #7r, denote by 

r s := ]T m„(l) = 2 #B« 

— (s) 

the number of elements in B n counted with their multiplicities. Now sort 

the elements ii, I G B w , in decreasing order to obtain a vector x^ s ' = 
(Zi, . . . , l rs ) with ii x > . . . > i[ rs , where each element %% is supposed to occur 

— ( s ) 
exactly m 7r (/) times. If ii = ii> for some /,/' G B^ , we use the convention 

that the lower index comes first. 

(ii) Construct a graph G with vertex set V{G) = {1, . . . , k} by drawing edges 

between the vertices a4/-i anc ^ x 2i f° r an y s = ^^ ■ ■ ■ > T^ 71 " an( ^ an y ^ = 

1 ^ 

To see that G is indeed an element of X(7r), we define for any s = 1, . . . , j^ir the 
subgraph G4 of G to be the graph with vertex set B w and edge set En (G) ind uced 



by the vector x^ s '. These subgraphs obviously fit in the situation of Definition 4.1 



Now fix any G G X(7r) and let T m (ii, G) denote the set of all tuples i = (h, ■ ■ ■ ,ik) G 
{!,..., m} which induce G in the construction above. Equation (4.1 ) thus becomes 



lim — E [tr (W^)l 



#7r 



TreP(fc) G6X(tt) (ii,...,i fe )er m (7r,G) s=l 



leSl' 5 



(4.3) 



if the limits exist. 
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4.3. Reduction of the set X(7r). We want to eliminate those graphs in T(jr), 
7i G V(k), that do not contribute to the limit in (4.3). We will see that these are 
graphs that do not have sufficiently many components. Therefore, recall that the 
connected components of G are cycles, and let 1 < r(G) < k be the number of 
such cycles denoted by G\, . . . , G r (G)- We denote the vertex and the edge set of Gi 
by V{Gi) and E(G t ), respectively. Defining #G Z := #V(G t ) = #E{G L ), we can 
identify Gi with a sequence (vi(Gi), . . . , v#G t (Gi)) of vertices, such that 



V(G l ) = {v 1 (G l ),...,v #Gl (Gi)}, 

E{Gi) = {ei(Gi), . . . , e#G t (Gi)}, with ej{Gi) connecting the vertices Vj{G{] 
and Vj + i(Gi), where j^G\ + 1 is identified with 1. 



Further, for e G E(G), we denote by /x(e) = (/^i(e),// 2 (e)), yUi(e) < /-^(e), the tuple 
of vertices connected by e. With this notation and assumption (A2), we conclude 
that for any {ii,...,i k ) G T m (n, G), 



I] E }|a(z,,l)^W <c(fc)n II ^wW. */«(«)) 



=1 W s) 



s=1 ee£[ s) (G) 



r(G) #G, 

C(k) Y[ AVileliWejl'^inn^SW'VtGi))' 
ee-B(G) J=l j=l 



where El s (G), s = 1, . . . , #7r, are the edge sets described in Definition 
obtain the estimate 



4.1 



We thus 



(i 1: ...,i k )ET m (n,G) 



#- 



]Je J! o(i,,i) 



m,r(Z) 



= 1 L rf 



m r(G) #G, 

ti,...,ifc=l 1=1 j=l 

r(G) m #G t 

=c ( /c ) n yi n t '^'^+ 1 )' 

Z=l ti,...,t # G,=l j=l 



where we used the fact that different components have distinct vertex sets for the 



latter identity. Since t'(i,i' 



a 



\i-i'\ 



decays exponentially, we know that the right 



hand side in the equation above is of order O (m r<yG ^ = O (n r ^ G ^. In particular, 
any graph G G T{n) with r(G) < k — j^ix + 1 gives negligible contribution to the 
limit in (4.3). The following lemma states that in this case, there are only graphs 



with k — #7r + 1 components left. 



Lemma 4.3. Let tx G V(k) with q := j^ix < k. Any graph G G X(7r) has at most 
k — q + 1 connected components. 
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Proof. First note that for any A C {1, . . . , q} with j^A < q, we can conclude that 



>(*) 



j(«) 



{J s£A B w ) n ( IJseA c B w ) 7^ 0- Indeed, an empty intersection implies 



'elK 



W 



i-ie 



IK S) - 



But in this case, the identity [J S&A Bn = {1, • . . , k} holds, being a contradiction to 
#A<g = #vr. 

Now con sider a graph G G X(7r) with the subgraphs Gi- , . . . , Gn as in Defini- 
tion 4.1 Recall that each subgraph Gi has vertex set B^ and edge set i<4 (G) 
with #En (G) = #-B4 . Start with s = 1. The maximum number of different com- 



.(i) 



(i) 



ponents the vertices of G n belong to equals the number of edges in G n ■ If g = 1, 
the proof is finished since we have at most #B„ = k components. Otherwise take 



t(«) 



(i) 



some different subgraph G n , s — 2, . . . , q, that has a common vertex with G w . Our 
considerations at the beginning of the proof with A = {1} ensure that this choice is 

(s) (s) 

possible. Thus, G n induces at most #-£% — 1 new components in G. Proceeding 
now by taking in each step a subgraph that has a common vertex with one of the 
subgraphs already considered, we see that the number of components of G does not 
exceed 

#S« + J2(#B^ -1) =k-q+l. 

s=2 

This completes the proof. 

□ 



Remark 4.4. The proof of Lemma |473] makes obvious that if we consider some graph 
G € X(7r) with k — #7r + 1 components, then for any s — 1, . . . , #7r, all edges of G-k 
must belong to different components in G. 

Let X*(7r) denote the set of all graphs G G X(7r) with r(G) 
considerations above allow us to conclude that 



(*) 



fc - #tt + 1. Our 



lim -E [tr (W*)l 



n-¥oo m 



!™ E ^ E e fi4n^.D 



n.-s>oo ■' — ' mn" 

neP(k) 



\m v (i) 



Gex* (tt) (u,...,i fc )er m (7r,G) s=l L ie5 



w 



if the limits exist. 



(4.4) 



4.4. Combinatorial results on the sets T*{ir). In order to calculate the limit 
in ( |4.4 ), we need to deal with the sets X*(7r) in more detail. Therefore, it will 
prove useful to distinguish between crossing and non-crossing partitions. A partition 
7i G V(k) is called crossing if there are elements i < j < i' < j' such that % ~ n i' 
and j ~7r j', but i,i' are not in the same block as j,j'. Otherwise, tt is said to 
be non- crossing. We denote the set of all non-crossing partitions of {1, ... , k} by 
NC(l,...,/c) = NC(/c). For any n G NC(fc), we will resort to the notion of the 



14 



OLGA FRIESEN AND MATTHIAS LOWE 



Kreweras complement K(tt) G NC(fc) (cf. |NS06j . Definition 9.21). To define K(jr), 
consider the numbers 1, . . . , k and 1, . . . , k. We interlace them in the alternating 
way 1 1 2 2 . . . k k. Then, K(ir) G NC(1, . . . , k) = NC(Jfc) is the partition with the 
following two properties: 



(i) If 7r U K(7r) is the partition of {1, 1,2,2, ... ,k, k} consisting of the blocks 
» l #*\ B% } , ..., B<j*$ w) \ then nUK(rc) G NC(1, 1,2,2, ... ,k,k); 



rv ' • r(#0 r(1) 

£>7r , . . . , -Dtt • t5 T 



(ii) if a further partition a G NC(1, . . . ,k) satisfies the property irUa G 
NC(1, 1, 2, 2, . . . , k, k), then K(ir) is bigger than a in the sense that any 
block of a is contained in some block of K(n). 

The construction of the Kreweras complement is illustrated in Figure [2] Since 
K 2k (n) = n, we can conclude that the map K : NC(fc) —¥ NC(fc), n \-¥ K(n), is a 
bijection. A further property we will resort to is the equality #K(tc) = k — #n + 1 
(for more details see |NS06j ). The following lemma reveals the structure of the sets 
I*(/k), and puts them into context with the Kreweras complement. 



4' • 




v- 




Figure 2. Here, we take k — 5, and it = {{1,2,4}, {3}, {5}}. In 
the first circle, we connect the elements that are in the same block 
of 7r, and draw the vertices 1', . . . , 5'. The Kreweras complement is 
then obtained by connecting as many primed vertices as possible with- 
out crossing any line. This yields K(n) = {{1'}, {2', 3'}, {4', 5'}} as 
indicated by the dashed lines in the second circle. 



Lemma 4.5. Let k G N and n G V(k). 
(i) If it is crossing, we have I*(tt) 



ii 



If n is non-crossing, then #I*(n) = 1. Moreover, it is the Kreweras com- 
plement of the partition induced by the unique graph G G Z*(ir) by taking 
the components as blocks. 
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Proof. We want to verify both statements by induction over k G N. Therefore, it will 
be necessary to relate any partition 7r G V(k) to some partition in V(k — 1). To this 
end, we define for any I — 1, . . . , k a partition %i G V(k — 1) obtained from n by first 
deleting I and then, relabeling any j G {/ + 1, . . . , k} to j — 1 . We now want to assign 

a graph Gi G X(7T/) to G G I(tt). Thus, suppose that / G Bn for some s = 1, . . . , #7r. 

— ( s ) 
In particular, we have that / + 1 G S w . By definition of consistent graphs, / and 

— (s) 

I + 1 are connected to vertices p and q, respectively, which are both elements of B v . 
Hence, we can substitute the edges {l,p} and {/ + l,q} by {/,/ + 1} and {p, q} to 
obtain a graph which is still an element of X(7r). Now eliminate the edge {/, I + 1} 
and take the remaining edge connected to I and link it to Z + 1, instead. Conse- 
quently, I has become an isolated vertex which can be erased. After relabeling the 
vertices as before, we finally get a graph Gi G I(tci). We now distinguish three cases: 

Case 1: {1} is a singleton of n. In this case, we obtain that B n = {1,1 + 1}. In 
particular, there is an edge between I and / + 1 in any graph G G X(7r). The pro- 
cedure above then guarantees that Gi and G have an equal number of components. 
Since #7^ = #7r — 1 and thus, k — #n + 1 = {k — 1) — j^ixi + 1, we further obtain 
that Gi G X*(7r,) if and only if G G X*(vr). 

Case 2: I ~ 7r I — 1. Assume that G G T*(-k). Then, the vertex I necessarily has a 
self-connecting edge. Thus, Gi has one component less than G. In this case, the fact 
that #7T; = #tt and (k - #7T + 1) - 1 = {k - 1) - #7Tj + 1, implies that Gi G l*{ixi) 
if and only if GgZ*(tt). 

Case 3: {/} is not a singleton of tt and I </> n I — 1. If this is the case, then it might 
happen that we merge two different components when substituting the edges in G. 
Hence, Gi has either as much components as G or one less. 

We want to remark that in case 1 and 2, we have a bijection between X*(7r) and 
X*(7T/). Indeed, this can be explained by the reversibility of the construction of Gi. 
The simpler case is the second one where we only need to re-insert the vertex / and 
draw a self-connecting edge. In the first case, I has to be re-inserted, too. How- 
ever, we have to argue why there is a unique way to connect / to Gi which leads 
to the graph G. Therefore, assume without loss of generality that Bi t ' denotes the 
block of I in tti. Since Gi is a ^-consistent graph, we know that / is conn ecte d to 

the 



some j G B n . Further, I is connected to a second vertex p. By Remark 



4.4 



fact that Gi has the maximum number of components implies that either p = j 

or p G" B . Consequently, the choice of p is unique. To obtain G from Gi, we 
thus need to introduce a new vertex /'. Since /' is supposed to adopt the role of 
the vertex following / — 1, we substitute the edge {l,p} by {l',p}- Now relabel all 
vertices q G {I, . . . , k — 1} to q + 1 and /' to /. Due to the fact that the block {/} is 
a singleton in ir, we are forced to draw an edge between / and I + 1. But then we 
get exactly the graph G. 
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(i) Suppose that n G V(k) is crossing. Since a crossing partition requires at least 
four elements, we start with k = 4. In this case, the only crossing partition ir G V(4) 

is given by vr = {{1, 3}, {2,4}}, implying that B^ = B^ ] = {1,2,3,4}. Hence, a 
graph G G X{tt) has at most 2 components. However, G G 1*{tx) is supposed to have 
k — #7r + 1 = 3 components which allows us to conclude that, indeed, T*{n) = 0. 
Now take any k & N and a crossing partition 7r G V(k). Fix some I G {1, . . . , k} 
such that tti is still crossing. This choice is possible whenever k > 5. Further, 
suppose that there is some G G X*(tt), i.e. G has k — #tc + 1 components. Our 
construction above yields that in case 1 and 2, Gi G Z*(tti), which is contradictory 
to the inductional hypothesis. Assuming that case holds, we obtain that Gi has at 
least k — #7r = (k — 1) — j^ixi + 1 components. This is also impossible. To sum up, 
we have Z*(n) = 0. 

(ii) Suppose that tt G V(k) is non-crossing. Here, we need to start with k = 1, 
implying that it = {{1}}. Obviously, there is exactly one possibility to obtain a 
consistent graph G, which can be realized by drawing a self-connecting edge for 
vertex 1. In particular, we have one component. This is the maximum number in 
this case and we see that Z*{tt) contains exactly one element. The partition induced 
by G is equal to it, and K(tt) = n since k — 1. Hence, (ii) holds. 
Take any k G N and assume that n G V(k) is non-crossing. Then, we can find 
some I G {1, . . . , k} such that either {1} is a singleton, or I ~ ff / — 1. These are 
the cases 1 and 2 in the construction at the beginning of the proof. Since they 
ensured a bijection between X*(7r) and Z*(iii), the inductional hypothesis yields 
#I*(tt) = #I*(tti) = 1. It remains to verify that n is the Kreweras complement of 
the partition induced by the unique graph G G X*(7r). We will denote this partition 
by rj. Let rji be the partition induced by Gi. In particular, we have K(r)i) = 7Tj. 
First assume that {/} is a singleton in -k. In this case, {I, I + 1} is a block of rj. As 
a consequence, K{rj) is the partition obtained from K(j]i) = tci after relabeling and 
inserting the block {/}. This is exactly the procedure how to re-construct it from 
ill, implying K {rj) = n. Now suppose that I ~ 7r I — 1. Here, {1} is a singleton in rj. 
Hence, we obtain K(rj) from K(j]i) if we relabel the elements q G {I, ... ,k — 1} to 
q + 1, and add the element / to the block of / — 1. Again, the resulting partition is 
equal to tc. This proves (ii). 

□ 

For ii G NC(fc), let G(tt) denote the unique element in X*(ir), and define Tm^n) : = 



T m (7r, G(tt)). Lemma 4.5 now entails the relation 



lim — E [tr (W*)l 

n— »oo m 



■si e = e n* n *.ir" m 



TreNC(fc) (n,...,^)6T m (7r) 8=1 



*# 



(4.5) 



if the limits exist. 
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4.5. A representation of the joint moments. Fix it G NC(/c) and (i\, . . . , i&) G 
Tm(7r). For convenience, we put G := GJn). Recall the subgraphs G^ := Gi- , s 
1, . . . , t^7t, as introduced in Definition 



4.1 



Denote by E«(G) := KV . .,e^ <.,} 
the set of the edges of G^ S K To finally apply formula (Al) in our context, we define 
for any / = !,..., #M s) 



•00 _ • 

hl-l — Vl(e«V 






We then have 

#7T 



#7T . #B. 



« 



he n a(i„i)™-« =n ( n *(4 j Li.4' ) )+«(«i' ) .— • 



00 

2#B 



« 



Recall that we denoted by G\, . . . , G fe _ #7r+1 the components of G, and the edges of 
Gi by {vj(Gi),Vj + i(Gi}}, j = 1, . . . , #G/. With this notation, we obtain 



#t 



n^ n 



OU/ 



Omjr(i) 



s=l 



■rf 



fc-#7T+l #G( 

n n*««- 

Z=l j=l 



+ #(zi,...,z fc ) 



where 



R' (ii,. ..,ik) 



e n «('?'.■■■ 



AC{l,...,#7r},seA 
A^0 






#B 



M 



seA c Z=l 



6 2Z-1> 6 2( 



We want to verify that R' (ii, . . . ,ik) gives negligible contribution to the limit. 
Therefore, fix A C {l,...,#7r}, A ^ |. Without loss of generality, we assume 
that 1 G A. Taking account of the identity in (Al) and the estimate in (A2), we 
conclude that for any s — 1, . . . , #7r, 



i=i 



i L-00 ,•(«) 

6 2Z 



Hence, 



nl^- / »^- 



seA 






rf 



n n K41.4?) 



seA c z=i 



<c(Jfe) i?(4 1} 5 



2#B. 



(i) 



n n 

s=2 1=1 



#B^ 



t'(l {s) & ] 



#k #B { n 3) 



*<<*> e e n* 1 (•■&-.)■•&)) n n f, (^ 

j=l ffg5 » 1=1 s=2 J=l 



2/ 



Now fix j G {1, . . . , #-£% } and a E S J (1) . Define a graph G' obtained from G 
by deleting the edges in E^(G). Since all edges in E^(G) belonged to different 
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components by Remark 4.4 G' has still k — #7r + 1 components. Denote by G', the 
graph obtained from G' by inserting the edges 

|^<r(2J-l) \ e \ a (2l-l)/2\ ) >^<r(2J) \ e \„{2l)/2\) ) ' l = *> • • • ' h 

where // ff (z) := Mi if cr(Z) is odd, and otherwise /i^ := /i 2 . The definition of the 
set S 3 m entails that there is at least one edge in G\ which was not contained 

in G. Hence, at least two components of G' are merged when constructing G"-. 
Consequently, G'- has d < k — #ir components which are either complete cycles or 
open cycles, i.e. one edge is missing. Denote those components by G' 1; . . . , G'^ d . We 
now have 

j #7T #Bi S) d 

n^G'Sa-ij'^ojn n ^ (*«-n 4?) =n n ^viW'^w). 

Z=l s=2 Z=l J=l eSE(G^) 

and 

d dm 

e n n ^(viW'W))^]! s n ^vw'^wi- 

(n,...,i fc )e7k(7r) J=l eeE(G') 1=1 n,...,i #G / =1 eeE(G') 

The exponential form of t'(i,j) ensures that the right hand side is of order m d . 
Consequently, 

^ i? , (z 1 ,...,z fc ) = 0(m fe - # -), 

(Jl,...,i fc )eTm(7r) 

implying 



lim — E [tr (W*)l 



fe-#7T+l#G ! W 



j™ z, mnfc -#. z, n n ^H^whs+i^w))' ( 4 - 6 ) 

TreNC(fc) (H,...,Jfc)eT m (7r) / = 1 j = l 

if the limits exist. 

4.6. An extension of the set 7Jrs(vr). If we summed over all elements (ix, ... , ijt) G 
{1, . . . ,m} fc instead of over all tuples in T m (n), we would obtain traces of powers 
of T m on the right hand side of (4.6) which would enable us to calculate the limit. 
The next lemma gives us the justification to do so. 

Lemma 4.6. We have 
lim — E[tr(W*)l 

n-Kx> 777, L v n/J 

m fc-#7r+l #G t (n) 

= i™ Z mn k -#- S II II ^(S(g ; W) 5 S + i(g ; W)) 

TreNC(fc) ii,...,i fe =l /=1 j=l 



fc-#7T+l 

n 

TreNC(fc) J=l 



lim F "4*- FT trflt G;W )- 
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Proof. We have already seen how the second equality can be obtained, e.g. in Section 



4.3[ To see that the first equality holds, let ir G NC(fc) and put G := G(ir). We want 
to verify that (T m (7r)) c gives negligible contribution to the limit in (4.6). Thus fix 



(«i, . . . , ik) G (7^i (7r)) . Being not an element of the set 7^(vr) means by definition 
that there is an s = l,...,#7r and two edges e,e' G E{G) such that the ends 

/xi(e),/x 2 (e) and y Ui(e'),/i 2 (e / ) are elements of B w but z Ml(e) < i^^ < i^ e) < i^ e >)- 
We then have 



*'(Vl(e), Va(e)) *'(Vi(e')' W)) = aW-HMlM+WO"^^) 

= *'(Vi(e)> V2(e')) ^(ViCe')' Va(e))- 



(4.7) 



Since G has the maximum number of components, Remark 4.4 yields that e and e' 



belong to different components of G. Consequently, substituting the edges e and e' 
by the edges {/ii(e'), /12(e)} and {/xi(e),//2(e')} leads to a new graph G^ e ' e ' G X(7r) 
that has r(G^ e ' e ^) = k — #n components. These considerations and relation (4.7) 
imply 



fc-#7T+l #Gl k-#7T #G i (E ' e ' ) 

n nt(iv J (G l ),iv J+1 (G l ))= n n *'(* 



«,• G 



(e,e')\,« 



^ + l( G i 



(e,e') N 



Further, by assumption (A2), we know that \t(i, i')\ < ct'(i,i') for any i,i' G N. 
Hence we obtain 

/c-#7T+l #G, 

z n n MstGii'^+itGi))! 

(H,...,i fc )6(7m(7r)) c J=l i = l 



m. k—#ir #G ( 

£ e e n n *' 

e,e'e£(G) n,...,i fc =l Z=l i=l 



%(g<-'))'% +1 (g<-'): 



C (m fe - #w ) 



and, consequently, 



fc-#7T + l #G,(ff) 

i™ z mn fe-#- z) n n ^^•(G.^^vico.cir))) 



TreNC(Tr) (il,-,ifc)e(T m (7r)) c «=1 j=l 

This completes the proof. 



□ 



Lemma 4.6 and relation (2.1) now yield 



lim -E ftr (Wl)l = lim V ( m ^ # " TT + I tr (T# G <M 

TreNC(fc) /=1 

= e **-** n *w>- 

7reNC(fc) Z=l 



(4.8) 
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4.7. Non-crossing partitions. Recall that for any it G NC(/c), Lemma 45] pro- 
vided us with the identity K(r)) = it, if r\ denotes the partition induced by G(ir). 
Since K : NC(fc) — >■ NC(fc) is a bijection, and #K(i]) = k — #rj + 1, we find that 

TreNC(fc) 1=1 TrSNC(fc) i=l 



To finally obtain the representation in Theorem |2.1[ we want to sort the partitions 
in NC(fc) by the number and the size of their blocks. Thus, define for any i\, . . . , i^ G 
{1, . . . , k} the set NC(fc; i%, . . . , ik) of all partitions in NC(fc) with i\ blocks of size I, 
I — 1, . . . , k. Note that if some partition tc G NC(fc; ii, . . . , ik) has q = k—s+1 blocks, 
then i s+ i — . . . — ij. — 0. Indeed, if 7r had a block consisting of at least s+1 elements, 
we would have at most k — (s + 1) elements left to form the remaining q — 1 = k — s 
blocks. Hence, we will write NC(fc; z 1; . . . , i s ) instead of NC(/c; ii, . . . , ik) whenever 
#7r = k — s+1. Note that i\+. . .+i s is the number of blocks and ix+2i 2 +. . . + si s the 
total number of elements of any partition tt e NC(fc; ii, . . . , i s ). Thus we consider 
only tuples (ii, . . . ,i s ) G {0, . . . , k — s + 1} S satisfying ii + . . . + i s = k — s + 1 and 
%\ + 2i 2 + . . . + si s = k. Now we get 

E y**' 1 II e *b^ = E y k - s E #NC(A;;, 1 ,...,g h^. 

TreNC(fc) 1=1 8=1 ii+...+i s =fc-s+l, i=l 

il+2i 2 +---+si8=fc 

It remains to determine #NC(fc; i 1; . . . , i s ). This can be achieved with the help of 

Lemma 4.7 ( |Kre72j . Theorem 4). The number of non- crossing partitions it G V(k) 
with i\ blocks of size I, I — 1, ... ,k, equals 

k\ 1 



(k-q + l)\ h\-...-i k \ 

where q := #7r = i\ + . . . +ik- 

We thus obtain that 



lim -E [tr (Wl)] = f" /- *: V TT ?L 

«=1 ii + ...+i s =fe-s+l, /=1 

il+2i 2 +..-+si s =fe 



which is exactly the statement of Theorem 2.1 
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